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Abstract 

Inspired by works on information transmission through quantum chan- 
nels, we propose the use of a couple of mutual entropies to quantify the 
efficiency of continual measurement schemes in extracting information on 
the measured quantum system. Properties of these measures of informa- 
tion are studied and bounds on them are derived. 

1 Quantum measurements and entropies 

We speak of quantum continual measurements when a quantum system is taken 
under observation with continuity in time and the output is not a single ran- 
dom variable, but rather a stochastic process [1,2]. The aim of this paper is 
to quantify, by means of entropic quantities, the effectiveness of a continual 
measurement in extracting information from the underlying quantum system. 

Various types of entropies and bounds on informational quantities can be 
introduced and studied in connection with continual measurements [3-5]. In 
particular, in Ref. [5] the point of view was the one of information transmission: 
the quantum system is a channel in which some information is encoded at an 
initial time; the continual measurement represents the decoding apparatus. In 
this paper, instead, we consider the quantum system in itself, not as a trans- 
mission channel, and we propose and study a couple of mutual entropies giving 
two indexes of how good is the continual measurement in extracting information 
about the quantum system. 

1.1 Algebras, states, entropies 

From now on TL will be a separable complex Hilbert space, the space where our 
quantum system lives. 



1.1.1 Von Neumann algebras and normal states 

A normal state on £(H) (bounded linear operators on H) is identified with a 
statistical operator, T(H) and S(H) C T(TL) are the trace-class and the space 
of the statistical operators on 7i, respectively. 

Let (fi, F, Q) be a measure space, where Q is a er-finite measure. We consider 
the Vt^-algebras L°°(n,T,Q) and L°°(n,F,Q:£(H)) ~ L°°(0, T, Q) <g> £(H). 
Let us note that a normal state on L°°(fl, J 7 , Q) is a probability density with 
respect to Q, while a normal state a on L°° (fi, T, Q; £(H)) is a measurable 
function uo i— > a(uj) e T(H), ct(w) > 0, such that Tr{a(a;)} is a probability 
density with respect to Q. 



1.1.2 Relative entropy 

The general definition of the relative entropy S(E|II) for two states £ and II is 
given in [6] ; here we give only some particular cases of the general definition. 

Let us consider two quantum states a, t 6 S(H) and two classical states 
qk on L°°(0, J 7 , Q) (two probability densities with respect to Q). The von 
Neumann entropy, the quantum relative entropy and the classical one are 

5 q (r) :=-Tr{rlnr}, S q (a\\r) = Tr{<r(lna - lnr)}, (1) 

Sc(«i||«2)= / Q{du>) qi {w)ln^. (2) 
Jn 12 (w ) 



Let us consider now two normal states <7fc on L°° (jl, J 7 , Q; £(H)) and set 
qk(oj) := Tr{crfc(cL>)}, Qk{u) := Ok(uj) / qk{oj) (these definitions hold where the de- 
nominators do not vanish and are completed arbitrarily where the denominators 
vanish). Then, the relative entropy is 



S(<7i\\a 2 ) = / Q(duj) Tr {<7i(a;)( ln<7i(w) - lno^M)} 
Jn 

= Sc(«l||«2)+ / Q(dcu)q 1 (uj)S q (g 1 (Lu)\\g 2 (u J )). 



(3) 



We are using a subscript "c" for classical entropies, a subscript "q" for 
purely quantum ones and no subscript for general entropies, eventually of a 
mixed character. Having used the natural logarithm in these definitions, the 
entropies are in nats. To obtain entropies in bits one has to divide by In 2. 

The following result is very useful ( [6] Corollary 5.20 and Eq. (5.22)). 

Proposition 1. Let Hi (g> n 2 and £12 be normal states of the tensor product 
von Neumann algebra Mi ® M2 and let Si = £12^ ., i = 1,2. Then, 

s(Ei 2 ||ni g) n 2 ) - s(Ei||ni) + s(Ei 2 ||Ei ® n 2 ) 

= S(Ei||ni) + S(E 2 ||n 2 ) + S(Ei 2 ||Ei ® E 2 ) u 



The quantity 5'(Ei 2 ||Ei E 2 ) is the relative entropy of a state with respect 
to its marginals; this is what we call mutual entropy. 
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1.2 Instruments and channels 

1.2.1 Channels 

Let Mi and Mi be two VK*-algebras. A linear map A* from M2 to Mi is 
said to be a channel ([6] p. 137) if it is completely positive, unital (i.e. identity 
preserving) and normal (or, equivalently, weakly* continuous). 

Due to the equivalence [7] of w*-continuity and existence of a preadjoint A, 
a channel is equivalently defined by: A is a norm-one, completely positive linear 
map from the predual A^i* to the predual M 2 *- Let us note also that A maps 
normal states on Mi into normal states on M 2 - 

A key result which follows from the convexity properties of the relative en- 
tropy is Uhlmann monotonicity theorem ([6], Theor. 1.5 p. 21), which implies 
that channels decrease the relative entropy. 

Theorem 2. IfT, and IT are two normal states on Mi and A is a channel from 
Mi, -» M 2 *, then S(S||n) > 5(A[E] || A[II]). 

1.2.2 Instruments and POV measures 

The notion of instrument is central in quantum measurement theory; an instru- 
ment gives the probabilities and the state changes [8,9]. 

Let (Q, J 7 ) be a measurable space. An instrument X is a map valued measure 
such that (i) 1(F) is a completely positive, linear, bounded operator on T(H), 
Vi* 1 G J 7 , (ii) X(fl) is trace preserving, (iii) for every countable family {Fi} of 
disjoint sets in T one has £\ Tr {al{Fi)[p}} = Tr {al (U, F { ) [p]}, Vp e T(H), 
Va e£(H). 

The map F 1— > Z(F)*[1] turns out to be a positive operator valued (POV) 
measure (the observable associated with the instrument X). For every p 6 S(H) 
the map F P p {F) := Trj^i* 1 ) [p] } is a probability measure: the probability 
that the result of the measurement be in F when the pre-measurement state is p. 
Moreover, given the result F, the post-measurement state is (P p (F)^ T(F)[p]. 

1.2.3 The instrument as a channel 

Given an instrument X with value space (Q,F) it is always possible to find a 
cr-finite measure on (£l,T) (or even a probability measure), such that all the 
probabilities P p , p £ S(Ti), are absolutely continuous with respect to Q. 

Theorem 3 ( [10], Theorem 2). Let X be an instrument on the trace-class of a 
complex separable Hilbert space H with value space (fi, T) and let Q be a a-finite 
measure on (fi,^ 7 ) such that Tr{X(»)[p}} <C Q, Vp £ S(Tt). Then, there exists 
a unique channel Aj from T(H) into L 1 (fi, J 7 , Q; T(J-Cj) such that 

E Q [/Tr{aAx[p]}] - f f ( w ) Tr {a X(dcj)[ P }} (5) 

V P eT(H), Vae£(H), V/ e L°°(n, T, Q). 

Viceversa, a channel A from T(H) into L 1 (O, J 7 , Q; T(H)) defines a unique 
instrument X by 

X(F)[p]=E Q [l F A[p}], VpeT(H), VFeT. (6) 
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1.2.4 A posteriori states 

When p G S(H), then Aj[p] is a normal state on L°°(il, J 7 , Q; C{TCj) . Let us 
normalize the positive trace-class operators Ax[p](a>) by setting 

it (w) ■= \ {Tth ^p^y 1 axmm if Tr « i A M^)} > ° (7) 

P \p (pe S(H), fixed) if Ti n {Aj[p](uj)} = 

Then, we have 

[ TT p {u])P p (duj) =l(F)[p], VF G T , (Bochner integral). (8) 
Jf 

According to Ozawa [11], tt p is a family of a posteriori states for the instrument 
X and the pre-measurement state p. The interpretation is that tt p (u) is the state 
just after the measurement to be attributed to the quantum system if the result 
of the measurement has been exactly lo. 

Let us note that p p := Tr{Ax[p]} and W p :— J n P p (&u)-k p (uj) — X(Q)[p] 
are the marginals of the state Ax[p] on the algebras L°°(U,!F,Q) and C(H), 
respectively. Then, S (Aj[p\\\p p if p ) is a first example of a mutual entropy. From 
Eqs. © and (J) we get 

S(A I [p]\\p p 7f p )= [ S q (7r p (cj)\\n p )P p (du) = S q (7r p ) - [ 5 q (^ P M)P p (d W ). 
Jn Jn 

(9) 

Quantities like this one are used in quantum information transmission and are 
known as Holevo capacities or x-quantities [12-14]; Eq. © gives the x-quantity 
of the ensemble of states {P p ,tt p }. 



2 Continual measurements 

Quantum continual measurement theory can be formulated in different equiv- 
alent ways. To construct our entropic measures of efficiency, we need two ap- 
proaches to continual measurements: the one based on positive operator valued 
measures, instruments, quantum channels [1,5,15] and the one based on classi- 
cal stochastic differential equations (SDE's), known also as quantum trajectory 
theory [2,4,16]. 

The SDE approach to continual measurements is based on a couple of sto- 
chastic equations, a linear one for random trace-class operators and a non-linear 
one for random statistical operators. The two equations are linked by a change 
of normalization and a change of probability measure. Both equations have a 
Hilbert space formulation, particularly suited for numerical computations. We 
shall use a simplified version of SDE's for continual measurements as presented 
in [2]. 



2.1 The linear equation 

Let H (t), Li(t), Rj(t), V£(t), Jfe(t) be bounded operators on H; their time depen- 
dence is taken to be continuous from the left and with limits from the right in 
the strong topology. The indices k,l,j take a finite number of values; the index 
r can take infinitely many values, but in this case the series J2 r ^fe (*)*^fe W ^ s 
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strongly convergent. Let the operator H{t) be self-adjoint, H(t) = H(t)*, and 
let us define (Vp € T(H)) 

Jk(t)[p\ .= E wvwr , j*w == am*] = E www > ( l0 ) 

r r 

£(t):=£ (t)+A(t)+>C2(t), (11) 
C (t)[p] := -i[H(t),p] + ^2(Li(t)pLi(ty - ^{hityUitlp}} , (12) 

Ci(t)[p] := E UiWpRjit)* - i {JZ,-(t)*iZ, («),/>}) , (13) 

By [ , ] we denote the commutator and by { , } the anticommutator. 

Then, we introduce a probability space (0, J-, Q) where the Poisson processes 
Nk{t), of intensity \ k , and the standard (continuous) Wiener processes Wj(t) 
are defined. All the processes are assumed to be independent from the other 
ones. We introduce also the two-times natural filtration of such processes: 

Tt = a{W 3 (u) - Wj(s), N k (v) - N k (s), u,v e [s,t], j,k = l,.. .}. (15) 

Having all these ingredients, we can introduce the linear equation of contin- 
ual measurement theory, for the a trace-class valued process at- 

da t = C(t)[a t _]dt + E (-Rj(*)o-t- + vt-RjW) dWj(t) 
j 

+ E (J^MQWtJ-at-^J (dN k {t) - X k dt) . (16) 

The initial condition is taken to be a non-random statistical operator: a® = 
a _ &S{H). 

The notation at_ means that, in case there is a jump in the noise at time 
t, the value just before the jump cr t of a has to be taken. More precisely, if 
the augmented natural filtration of the noises is considered, the solution can be 
taken to be continuous from the right and with limits from the left and er t _ is 
just the limit from the left. We prefer not to add the null sets to the natural 
filtration and by at we mean some J-^-adapted version of the solution. 



Properties of the solution. Let us consider now, for < s < t, the von Neu- 
mann algebra L°°(n,^, Q; £(H)) ~ L°° (Cl, , Q) ® £(H) (cf. Section [TXT) 
and let us give a name to the set of normal states on this algebra: 

S;:={t€L 1 (SI,F2,Q;T(?{)):t(u)>0, j Tr{r(w)} Q(6u) = 1 J . (17) 

• First of all, it is possible to prove that a t S 6> t °; we can say that the 
solution at time t of Eq. (fl6|) is a kind of quantum/classical state. 

• The marginals of at are (cf. Section ll.2.4[) : 
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— The probability density pt '■= Tr {at}. The probability measure 
Pt(u))Q(du)) will be the physical probability. 

— The a priori state at time t r\ t := Eq[ct(] G S(TL). This is the state 
to be attributed at time t to the system when no selection is done 
and the result of the measurement has not been taken into account. 

• Moreover, we define the random a posteriori state at time t p t = — o~t- 

Pt 

This is the state to be attributed at time t to the system known the result 
of the measurement up to t. 



Note that p = 1, p = a = r/ , rj t _ = T)t = r)t+ ■ 



2.2 Physical probabilities 



A very important property of Eq. (116p is that p t is a mean one Q-martingale, 
which implies that 



P t (dw) :=j>t(w)g(dw) 



(18) 



is a consistent family of probabilities, i.e., if < t < T, Pt{F) = Pt{F), 
VF £ T^. These are taken as physical probabilities. 

From Eq. (JTBJ) we have that pt satisfies the Doleans equation 



dpt = Pt_ mj (t) dWj (t) + 

I „ 7. 



1 (dJV fe (i) - X k dt) 



(19) 



where 

m j (t) = Tr{{R j (t)+R j {t)*)p t _}, fi k (t) = Tr { J k (t) Pt _ } 
The solution of this equation, with pq = 1, is 



(20) 



Pt = cxp 



E 



rrij (s) dWj (s) — — | rrij(s) ds 



E 





* i n £*W diVfe(s ) + f ( Afe - Mfc ( s )) ds 



(i 



A, 



(21) 



Remark 1. 1. The output of the continual measurement is the set of pro- 
cesses Wj(t), Nk(t), < t < T, under the physical probability P T ] T 
is a completely arbitrary large time. By the consistency of the proba- 
bilities (|18[) . Pt can be substituted by Pt in any expectation involving 
J-" ( °-measurable random variables (for t < T). 

2. By Girsanov theorem and its generalizations for situations with jumps, we 
have that, under the physical probability, the processes 



W j (t) = W j (t) 



rrij (s) ds 



(22) 



are independent, standard Wiener processes and Nk(t) is a counting pro- 
cess of stochastic intensity [ik(t)dt. 







3. Expressions for the moments of the outputs can be given; in particular we 
have the mean values 

E Pt [W j (t)} = I n^ds, E Pt [N k (t)] = [ v k (s)ds, (23) 
Jo Jo 

where 

nj(t) = Tv{(R 3 (t)+R 3 (ty) Vt } = E Pt [mj(t)}, (24a) 
v k {t) = Tr { J k (t)r] t } = E Pt [[i k (t)}. (24b) 

2.3 The non-linear SDE 

Under the physical law Pp, the a posteriori states pt satisfy the non-linear SDE 
d Pt = C{t)[ Pt _]dt + (Rj(t)pt- + Pt-Rj(t)* - m 3 {t)p t _) dWj(t) 

3 

+ E (^) M*)\Pt-] - Pt-) (dN k (t) - p k (t)dt) . (25) 

Let us stress that for the a priori states we have 

m =E Q [a t }=E Pt [p t ] (26) 
and that they satisfy the master equation 

^ t m=C(t)[r ]t }. (27) 

2.4 The fundamental matrix and the instruments 

To apply the notions of Section [1] to continual measurements, we need to see 
how such a theory is connected to instruments and channels [2-5] . This is done 
by introducing the fundamental matrix Af of (fTTJl) . This operator is defined by 
stipulating that Af [|uj)(itj|] satisfies (|T^)) with initial condition A|[|ui)(uj -|] = 
\ui){uj\, where {u; i = 1, . . .} is a c.o.n.s. in TL. It turns out that Af is a 
channel from T(TL) into L 1 (Q, jF t s , Q; T(H)) , or, by trivial ampliation, from 
L l (Cl,FZ,Q;T(H)) into L 1 (O, T T t , Q\ T{H)) , < r < s < t. Then, we have 

Af [o~ s ] =a t , A s t = AJ 1 o A^ , < s < u < t . (28) 
The instrument associated to this channel is 

l s t {F)[p] = Eq [l F A s t [p]} ee [ A?HWQ(dw), VF e F?. (29) 

J F 

The time evolution of the quantum states is the one generated by C(t) and we 
have 

U(t, s )[p]=l°(n)[p]=E Q [A s t [p]], (30) 

U(t,s)[r) s ] =T) t , U{t,s) =U(t,u)oU(u,s), 0<s<u<t. (31) 

According to the definitions of Section H723J the random statistical operator 
Pt is the a posteriori state for the instrument X t ° and the pre-measurement state 
Po = ?7o- 
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Another important property is 

Eghlf^Ajye^. (32) 

Indeed, by the first of (|28|) and the fact that Af is J-$ -measurable, we have 
Eq^I^] = A* [Eq[<7 s |.F ( s ]] . By the fact that all the noises have independent 
increments, we have that a s is independent from Tl and Eq^sI^-"/] = Eq[ct s ] = 
r] s . This gives Eq. $2$. 

3 Mutual entropies and information gains 

3.1 The information embedded in the a posteriori states 

The quantity a t is a state on Q; C{Hj) = L°°(Q, J 7 ?, Q) <g> C(H) and 

its marginals on L°°(£l, !F^, Q) and C(H) are p t and r]t, respectively. The mutual 
entropy S(at \\ptVt) is the "information" contained in the joint state with respect 
to the product of these marginals; more explicitly we have (compare with ([§])) 

S(<rt\\PtVt) = / Pt(duj) Tr {p t (ui)(\np t (uj) - In 77*)} 

and we can write 

S(a t \\p t r lt )='E Pt [S q (pt\\m)} = S q ( Vt ) ~E Pt [S q (p t )}. (33) 

This mutual entropy is a sort of quantum information embedded by the mea- 
surement in the a posteriori states. When the measurement is not informative, 
we have pt(^) = T)t and S(pt \\ptVt) = 0. It is zero also if for any reason it 
happens that rj t is a pure state. For instance, if U(t, 0) has a unique equilibrium 
state which is pure, then lim t ^ +oc S(crt\\ptVt) — even if the measurement is 
"good" . 

Let us note that from Eq. (|33|) we have the bound 

S(<J t \\ PtVt ) < S q ( Vt ). (34) 

When the von Neumann entropy of the a priori state is not zero, an instan- 
taneous index of "goodness" of the measurement could be S(a t \\ptVt) / S^rjt) , 
while a "cumulative" index could be f„ T ^i^Sl^tl dt . 

3.2 A classical continual information gain 
3.2.1 Product densities 

Let us consider any time s in the time interval (0, t) and let us decompose 
the von Neumann algebra L°°(0,jf,Q) as L°°(n,J^,Q) = L°°(n,J^,Q) ® 
L°°(Q, Tt, Q). Now, the density p t can be seen as a state on L°°(Q, T^,Q) and 
we can consider its marginals p® and pf on the two factors L°°(Q, .F , Q) and 
L°°(f2, J^t, Q), respectively. These marginals are given by 

p° s =E Q \p t \f% pt=E Q [ Pt \^}. (35) 

By using the fact that {pt, t > 0} is a martingale and by taking the trace of Eq. 
([52). we get 

p° s = Ps , p? = Tr{A?M}. (36) 
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By comparing the last equality with p t = Tr{<7t} = Tr{A° [770]}, we see that pi 
is similar to pt, but with s as initial time, instead of 0, and with rj s as initial 
state, instead of 770 . By this remark and Eq. (|21[) . we get 



Pi 



= expj^y^ J rrij(u; s) dWj(u) — - J mj(u;s) 2 du 



E 



A fc Js 



(37) 



where 



i j (t;s)=Ti{(R j (t)+R j (t)*)p s t _], n k (t;s) = Tr {j k (t)p s t _] , (38) 

(39) 



Pt 



Pt 



The random state p\ is the a posteriori state for the instrument X t s and the 
pre-measurement state ry s ; it satisfy the non-linear SDE 

Then, we can consider the mutual entropy S c (pt\\PsPt) ■ But the significance 
of this quantity is dubious, because the time s is completely arbitrary and, 
moreover, we could divide the time interval in more pieces. For instance, we 
can take the decomposition L°°(n,J^,Q) = L°°(n,J^,Q) ® L°°(n,J^,Q) ® 
L°°(il,!F^,Q) and we recognize that p^P^Pt is the product of the marginals of 
p t related to this decomposition. Taking a finer generic partition of (0, t) with 
to = and t n = t, we recognize that IIJ=i-Ptj ■ -1 * s a g am a product of marginals 
of ^4. To eliminate arbitrariness, let us consider finer and finer partitions and 
let us go to a continuous product of marginals. 

Let us note that we have 



lim rrij(t; s) 

s^t 



n 3 (t), 



lim^ fc (t;s) 

s~\t 



Then, for an infinitesimal interval we get 



Ps+d: 



n j {s)dW j (s) --n 3 (sfdi 



E 



Afc 



dN k (s) + (\ k - v k (s)) ds 



(40) 



and, so, the following density qt is the continuous product of marginals of pt- 



q t = exp 



E 



n j (s)dW j (s) ~ - / n 3 (s) 2 ds 



E 





\n U 4^dN k (s) 







A* 



(Afc - v k (s))ds 



(41) 



Notice that rij{t) and v k {t) are deterministic functions. Under the proba- 
bility qT(u)Q(duj), the processes Wj(t) — J * rij(s) ds are independent, standard 
Wiener processes and N k (t) is a Poisson process of time dependent intensity 
v k {t). 
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Under qT(u)Q(dui), the processes Wj, Nk have independent increments as 
under Q (so they can be interpreted as noises), but the means have been changed 
and made equal to the means they have under Pt- 

The fact that it is possible to consider a "continuous product of marginals" 
is not so unexpected; indeed, the theory of continual measurements is connected 
to infinite divisibility [15]. 

We have already seen that the marginals of pt with respect to the decompo- 
sition of the time interval (0, t) into (0, s) and (s, t) are p® = p s and given by 
Eq. ()37p . The analogous marginals for q t are q® = q s and 



q t = exp 



E 



E 



n j (s)dW j (s) -~J nj (sfds 
Vk{s) 



In- 



■<UV fc (s) 



(A fe - v k {s))ds 



= £. (42) 

<ls 



3.2.2 The classical mutual entropy S c (pt\\qt) 



The density qt is no more dependent on some arbitrary choice of intermedi- 
ate times and the measure qT(u))Q(dw) has a distinguished role and can be 
considered as a reference measure. So, we can introduce the relative entropy 



S c ( Pt \\q t )=E I 



Qt 



Being q t a product of marginals of p t , this quantity is a mutual entropy and, 
being q t the finest product of marginals, we can interprete S c (pt\\qt) as a mea- 
sure of the classical information on the measured system extracted in the time 
interval (0, t). Other reasons can be given to reinforce this interpretation. 

By Eqs. CO, ([2?]), 6U), (32) we have p° t = p t , g t ° = q t , q u = By 
Proposition [1] or by direct computation, we get 

S c (p t \\qt) - S c (p a \\q a ) = S c ( Pt \\p s q s t ), 0<s<t. (43) 

Firstly, by the positivity of relative entropies, this equation says that 

< S c ( Ps \\q s ) < SciptWqt), (44) 

i.e. that S c (pt\\qt) is non negative and not decreasing in time, as should be for a 
measure of an information gain in time. Moreover, the increment of information 
in the time interval (s,i) can be written as 



S c (pt\\p s q?)=Et 



Ps 



P± hl Pt/Ps 
Ps 



it/q s 



(45) 



has the same structure as S c (pt\\qt), 



This expression can be interpreted as a conditional relative entropy ( [17] pp. 
22-23). The quantity Eq In T Q S 
but it refers to the interval (s,t) and it is constructed with the conditional 
densities. We can say that Eq. (j4"3"|) expresses in a consistent way a kind of 
"additivity property" of our measure of information. 

Having the explicit exponential forms of the densities pt and qt, we can 
compute the explicit expression of the information gain. 
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Proposition 4. The explicit expression of the classical mutual entropy S c (pt\\qt) 
is 



L „■ Jo Jo 



fJ-k(s) In 



ds (46) 



Proof. By Eqs. (EU) and flU) we get 



ln^ = V 
ft V 



(m^s) - n J (s))dW^(s) - - / (toj(s) 2 - n,(s) 2 )ds 



E 

= E 



In 



Lik(s) 



(d7V fc (a) - A* ds) + / f A fe In - Mk («) + "it (*) 



(rn,(s) - nj-(s)) (dWj(s) - ™ i (s)ds) + - / (m.,-(s) - %-(s)) ds 



E 









\ n ^(diV fc (s)-Ms)ds) 



Mfc(s) 



M4-ln^4-U,U 



By point 2 in Remark [TJ the first term in the j sum and the first term in the 
k sum have zero mean under Pt (or under P t , by consistency). Therefore, Eq. 
(|4"5j) follows by taking the P t -mean of Inpt/qt and by taking into account Eqs. 
(1241 □ 



Remark 2. 1. By (|24b[) and Jensen inequality applied to the convex function 
aTnx, we have that both integrands in formula (|46p are non-negative and, 
so, we have 



d_ 

dt 



Soipt lift) = ^E Var Pt K- (t)] + £ Ep t 



Mfc(i) In 



Vk{t) 



> 0. (47) 



i k 

The positivity of this time derivative follows also from Eq, 

2. By the properties of relative entropy Ep T [S q (p t Wvt)] — is equivalent to 
Pt = r] t , Pt~&s. By Eqs. (|24| . ([47]) . this last relation implies the vanishing 
of the quantity (|4"T|) . So, we have 



Ep T [5 q ( Pi ||%)] = 



S c ( Pt \\q t ) = . 



(48) 



3. From Eqs. (HOI), (El, 63) we see that 

• if Rj(t) + Rj(t)* cx 1, then Varpjm^t)] = 0, 



if Jk(t) oc 1, then In 



0. 



This says that when both conditions hold for all j and k, no information 
is extracted from the system, whatever the initial state is. 



11 



3.3 A quantum/classical mutual entropy 

The two mutual entropies introduced in Sections 13.11 and 13.2.21 can be obtained 
from a unique mutual entropy 

S(a t \\qtVt) = f Q(dLu)Tr{a t (Lu)(liia t (Lu) -lnq t (Lu)r lt )} . (49) 

Indeed, by Proposition [T] or by direct computation, we get 

S(a t \\q t r) t ) = S(a t \\p tVt ) + S c ( Pt \\q t ) = E Pt [S q (p t \\rh)] + S c ( Pt \\q t ). (50) 

4 An upper bound on the increments of S c (p t \\qt) 
4.1 The main bound 

By Proposition [T]and Eqs. (|2"T]). (|3"7)) . (gT|), (O, the increment of information 
in the time interval (t, u) can be expressed as 

S c (p u \\qu) - S c (p t \\q t ) = SMlptpl) + S c (pt||«i). (51) 

Lemma 5. For < t < u, we have the bound 

< S c (puWptpi) < E P „ [S q (ptht) - S q (puWfQ] . (52) 

Proof. Consider the mutual entropy S(at\\ptf}t) introduced in Section 13.11 and 
apply to both states the channel A*. By Theorem [5] and the definition (|3"9")l we 
get the inequality 

Eft [S* (Pt\\vt)} = S (a t \\p t r, t ) > S (A*[<r t ]|KW) = S (a u \\p t ai) 
= S (puPuWPtplpl) = Ep„ [Tr {p u (lnp u + lnp u - In (p t p* ) - ln/4) }] 

= S c (p u \\ Pt p t u )+E Pn [S^W/Q] , 

and this gives ([52")) . □ 

Apart from the different notations, Eq. ([5"2"| is the bound (29) in Ref. [5]. 
From Eqs. (|40p and (|4"2"|) we get immediately 

ltaM = 0. (53) 

uit u — t 

Then, the second summand in the expression l|5ip of the increment of informa- 
tion becomes negligible with respect to the first when u { t. Therefore, from 
Lemma [5] we have immediately the following theorem. 

Theorem 6 (The bound on the derivative of S c {pt\\qt))- The following bound 
holds: 

o < ^ t SMqt) < EpASMIpI)]^ 

= ^-E Pt [SM]-^-E Pt [SM (54) 
at au u=t+ 
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Remark 3. We already saw in Remark [5] that Mp T [Sq(pt\\T]t)] — is equivalent 
to pt = Tit, Pr-a-S.; but this implies p u = p!^, Py-a.s., because in this case these 
two quantities, which satisfy the same equation, have the same initial condition 
at time t. Therefore we have Ep T [S^(p u \\pU\ = 0, Vu > t, and 



E Pr [5 q (p t ||r ?t )]=0 



-—Ep^smIpI) 



= 0. 



=t+ 



(55) 



4.2 Explicit computation of the bound 



All the derivatives can be elaborated and from Eq. (|54|) we get the following 
explicit form of the difference between the bound and the time derivative in 
which we are interested in. 



Proposition 7. By computation of all the terms appearing in Eq. 



we get 



u=t+ at 



<l E p T [5 q (p t )]-^Ep T [5 q (^)] 
= J2 E Pt [ Tr { Mt)Pt (In P* -Inrjt) - J k {t)[pt] {lnj k (t)[p t ] - In J k (t)[vt}) }] 

k 

+ ]Te Pt [Tr{R 3 (t) Vt [R 3 (ty, Inrit] - R 3 {t)p t [R 3 {t)\ lnp t ]}] 
+ ^E Pt [Tr{LK*)^[^(*)*, b-m] -Li(t)pt[Li(t)*, lnp t ]}] 



1 r r+°° 



du Tr <j Rj (t) * Rj (t)* Vt 



Pt 



U + Tjt 
Pt 



U + Tjt 



u + pt u + p t 



111 -R 3 {t)-^-R 3 {t) 



U + T}t 

1 -^w^w 



U + 7] t 
2 



u + p t 
2 



u + p t 
Pt 2 



U + T)t 



U + T)t 



Rj(i)—^ — Rj{ty 
u + pt n J u + p t n ' 



(56) 



Proof. Let us start with the term 4- Ep T [S q (p t u )] . By recalling that p* u 

u—t+ 

satisfies in u the non-linear SDE with initial condition r\ t at u = t and that 
rjt + £(t)[r)t\dt = T) t +dt, we get 

Pl+dt ~ Vt+dt = J2 M^w^t) + J2 - Vt) (dN k (t) - v k {t)dt) , 

3 k 

where 



Aj(t) := Rj(t)r) t + VtRj(t)* - nj{t)rit 



Tk{t) 



Vk{t) 



Jk{i)[vt], 



dWj{t) := dWj(t) - rij{t)dt . 

By setting also 
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we can write 



Vt+dt = 

V fc J k 

Moreover, by the properties of the increments of the counting processes, we have 

P \ +dt dN k {t) =T k (t)dN k (t), 



v k / 



(*) 



By putting these things all together and by using the rules of stochastic 
calculus, we get 

p\+dt ln p\+dt - m in m = 2 t Tfc (*) ln Tfe (*) ~ ^ ln d7Vfc (*) 



In L t + B(t)d* + 2 <*W,-(t) - ln 



+ B{t)dt ln Vt + ^ [In + dVi^-(t)) - \n Vt ] dW 3 \t). 



It exists a nearly obvious and very useful integral representation of the log- 
arithm of an operator ( [6] p. 51): 

Jo \ 1 + t t + A) 
By iterating this formula we get also 

In(A + B)-InA= / -B dt 

K ' J a t + A t + A + B 

+ °° 1 If 1 



t + A t + A\ t + A + B 
These two formulae and stochastic calculus rules allow to write 



E Pt [Tr{p* +dt lnp* +dt - Vt \n m }] = £ fofo) ~ ^M*))] v k {t)dt 



k 

r- + OC 



-dtV r duTrl , Vt „ Aj(t) — - — Aj(t) 
^Jo \{u + V t) 2 ]y> u + r, t 



3 

+ 00 



3 J ° 



du Tr j — — A, (t) — — Aj (t) 

+ dtTr(s(t) flnfjt + / , Vt , 2 du 
{ \ Jo (u + Vt) 2 
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By computing the integral we get 

p +00 



Tr |s(t) (lnr) t + J ^ du\ } = Tr {B(t) (lnr? t + 1)} 

= Tr {B(t) him} = Tr {[^W - J k (*)] % 
+ ^Tr{[i? j (t)r ?t i? i (t)* - i? 3 (i)*^Mln?7 f } 

+ 2 li:{[L,(t)%L,(t)* - £i(*)*M*)»7t] hffc} 
and by using the integration by parts with ^j^p = — M _^ t we have also 

V / + °° dw Tr ( — !— A, (t) — !— Aj (t) - - Vt -„ Aj (t) — !— Aj (t) ) 
r+00 r ^ 

=£/ ^{MQj-^Mty ' 



j 

r + oc 



u + rjt 
1 

u + Vt 



Y / du Tr Aj (t) , m A, (t) 

y Jo I (w + ry t ) 2 « + ■ 

/ +OO d U Tr(^^A ; (t)^^A 3 (0l 



From the previous formulae we have the final expression 

u=t+ ^ ^ ^(rj J 

y Tr {Rj (t) Vt [R 3 (t)*, In Vt ] } + ]T Tr {L,(t)^ [£,(*)*, In r? t ] } 



d 

du 



+ lY( f ™ duT* {R j (ty-^R j {ty-^ + -^R j (t)-^R j (t) 

+ — - — Rj(t)— — R 

U + T) t U + T) t ■ 

Analogously we get 

^ E Pt [SM] Y Tr {j k {t)[p t ) In - J fe (t)p t lnp t 

-y E Pt [Tr In ^]}] E Pr [Tr {L,(*)* la*]}] 

i 1 

1 r /'+ 00 ( 



u + p t 



Pt n Pt „ f. s . 2 p t 



2 



u + pt n 'u + p t nJ u + pt nJ u + p t ' 



(58) 

By (JSTJ), l[55|). (H7)) we get the statement of the Proposition. □ 
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^ S c (p t \\q t ) = 1 E Pr [5 q ( Pt )] - ^ E Pr [5 q (^)] 



Corollary 8. A sufficient condition to have the equality in the main bound 

(59) 

KAU, U — t + 

is to have Pt-o,.s. in uj (T >t) 
[V k r (t),Pt(u)] = 0, [Rj(t),(H(<»)]=0> Mt),p t (u)}=0, Vr,k,j,L (60) 

In the autonomous case, i.e. when H,V£, Rj, Li are time independent, we 
have that the conditions 



0. 



[£i,Tjto]=Q, Vr,k,j,l, (61) 



[H, no }=0, [VZ,r) ] = 0, [Rj^o 
imply Eqs. ([60]) and ([59|) Vi > 0. 
Proof. By the commutation relations (J5D]) we get 

J k (t)p t (In ^ - lnn t ) - Jk(t)[ Pt ] (In J k {t)[p t ] - In Jk(t)fa}) 

= Jk(t)pt (lnpt - ln77 f - \nJ k (t)p t + h\J k {t)rit) = 

and the first term in Eq. (|56p vanishes. 

By Eq. (|60| also the second and third term in Eq. (|56|) vanish because they 
explicitly involve vanishing commutators. 

Finally, let us consider one of the summands in ((ST)) . We have 



[ + AuTzIrM)*— P —R~ 
Jo I u + Pt 1 



(ty 



Pi 



u + p t 



y duTr ji?.,(f) 



N*2 Pt 



{u + p t ) 2 

= E Pt [Tr {Rjityipt}] = Tr {^-(t)* 2 ^} 



Similar formulae hold also for the other summands and the last term vanishes 
too. 

In the autonomous case, when the initial state r/o = po commutes with all 
the operators involved in the evolution equations, we get that Eqs. (f60|) hold for 
all t and the conclusion follows from the first part of the corollary. □ 
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